COVARIANCE STRUCTURE OF PARABOLIC STOCHASTIC PARTIAL 

DIFFERENTIAL EQUATIONS 
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Abstract. In this paper parabolic random partial differential equations and parabolic sto- 
chastic partial differential equations driven by a Wiener process are considered. A deter- 
ministic, tensorized evolution equation for the second moment and the covariance of the 
solutions of the parabolic stochastic partial differential equations is derived. Well-posedness 
of a space-time weak variational formulation of this tensorized equation is established. 



1. Introduction 

With general results on existence and uniqueness of solutions of stochastic partial differen- 
tial equations being available (see, e.g., [5] and the references there), the numerical solution of 
stochastic partial differential equations has received increasing attention in recent years. The 
most widely used numerical solution approaches are based on combinations of time stepping, 
space discretization, and sample path simulation. If the parabolic stochastic partial differen- 
tial equation is linear and driven by Q- Wiener noise, the linearity of the stochastic partial 
differential equation and of the mathematical expectation can be exploited to show that the 
expectation of the square integrable random solution satisfies the corresponding determinis- 
tic, parabolic evolution equation. In the present paper we show that the covariance operator 
of the square integrable random solution of a parabolic stochastic partial differential equation 
satisfies a deterministic, tensorized evolution equation with a measure- valued, nonseparable 
forcing term. We establish the well-posedness of this equation in tensor products of Bochner 
spaces via a novel, tensorized space-time variational formulation of this evolution equation. 
This variational formulation, while being of interest in its own right, can serve as starting 
point for space-time compressive, adaptive Galerkin discretization techniques as outlined in 
[7, 8, 1]. 

The outline of this paper is as follows: In Section 2 we introduce the required notation, 
and recapitulate basic results which are needed in the sequel. We review, in particular, 
the space-time variational formulation of linear, parabolic evolution problems from [9], and 
show how this can be tensorized by taking the tensor product of two such problems. In 
Section 3 we review the theory of stochastic partial differential equations of Ito type as 
stochastic differential equations in Hilbcrt spaces as presented in [3]. In Section 4 wc first 
present a tensorized, linear evolution equation for the second moment of the solution of a 
random evolution partial differential equation. We then state and prove the main result that 
the covariance operator of the mild solution of the stochastic parabolic partial differential 
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equation driven by Q- Wiener noise can be obtained as a weak, variational solution of a 
tensorized, deterministic parabolic evolution problem. 

2. Variational formulation of tensorized partial differential equations 

Let us review weak variational formulations of partial differential equations and solutions 
of tensorized equations in this section. Accordingly, we let {H,{-,-)h) denote a separable 
real Hilbcrt space and A : T>{A) C H ^ H he a linear operator, which we assume to be 
densely defined, self-adjoint, positive definite, and not necessarily bounded but with compact 
inverse. Then there exists an increasing sequence of real numbers (a^. A: G N), which tends to 
infinity, and an orthonormal basis (e^, k eN) of H such that Ack = (Xkek- The domain of A 
is characterized by 

oo 

V{A) := [4> G H, ^ efc)lf < +00}. 

fe=i 

Furthermore, —A is the generator of an analytic semigroup of contractions S = {S{t),t £ M_|_) 
and we are able to define the square root of the operator A. This operator A^/^ : — > H 
is given by 

00 
k=l 

for all (f) e X>(AV2)^ where 

00 

V{A'/^) := {0 G H, \\m := ^ ak{<P, e^fn < +00}, 

k=l 

and V := together with the norm || • \\v becomes a Hilbert space. The norm satisfies 

that ll^llv = m^/^^llif, for all 4> eV. Let us define the bilinear form a:VxV^M.hy 

for all eV. It is symmetric, continuous, coercive, and injective. In the following, let V* 
denote the dual of V. By the Riesz representation theorem we identify H with its dual and 
have the Gelfand triplet V C H = H* C V* . Then the hnear operator A : T>{A) C H ^ H 
can be interpreted as a bounded linear operator A : V ^ V* , A £ LiV; V*), via the bilinear 
form 

for (jyjilj £V, where y, (•, ■)y denotes the dual pairing between V and V* . Note that, although 
we assume that A = A* is self-adjoint, here and below we write A* when the operator appears 
as an adjoint operator. The operator A G L{V; V*) is boundedly invertible by the properties 
of a and the Lax-Milgram lemma, and its norm is bounded by 

Let us fix the time interval T := [0, T], for some T < +00, and define the Hilbert spaces 
X:=L'^{T;V) and y := L'^{T;V) D Hl^^y{T;V*), 

where 

^imC^;'^*) -t-^ ^ H\T;V*), <j){T) = 0}. 
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Let X* and y* denote the adjoint spaces with respect to the pivot space L'^{T;H), i.e., 

X* = L'^{T;V*) and y* = L'^{T;V*) + H~^{T;V). 
In this framework, let us consider the parabohc partial differential equation 

(2.1) idt + A)u = f 

with initial condition m(0) = uo £ H, i.e., we want to solve the weak variational problem to 
find, for given uq e H and / G an element u e X such that for all v e y 

(2.2) B{u, v) = y, if, v)y + (no, v{Q))h, 
where 

B{u, v) := riviuit), -dtv{t))y. + a{u{t), v{t))) dt = C y{u{t), {-dt + A*)v{t))y. dt. 
Jo Jo 

It is shown in Theorem 2.6 in [9] that the variational problem (2.2) admits a unique solution 
u & X and that the operator B := dt + A : X ^ y* is an isomorphism. 
Let us consider the tensor spaces 

and 

yi^) --y^^y. 

Since (A'(^))* = {X*Y'^\ we use the abbreviation X^"^^* and we similarly define y^'^^*, which 
can be rewritten as 

^(2)* ^ ^^2^^. y*^ ^ H-^{T; y))(2) 

^ L2(T;M)(2)(g)y(2)* + ii-i(T;M)(2)(g)y(2) 

+ L2(T; V*) ® H-^{T; V) + iJ-^(T; V) (g) ^^(T; V*). 

Here, we denote by (g) the tensor product which separates the spaces with respect to time and 
space. Let us define the tensorized bilinear form 

Jo Jo 

= ^,,,{u,{-dt + A*)<^^^v)^,,,„ 

for all u e X^^^i and v G y'^^\ Then since B = dt + A is an isomorphism so is B^^\ and the 
weak variational problem to find, for given uq G H^"^^ and / G y^'^^* , an element u G X^'^^ 
such that 

(2.3) B^^\u,v) = y(2).{f,v)y(2) + («o,^^(0,0))^(2), 

for all V G y^^\ admits a unique solution. The corresponding strong form of the tensorized 
partial differential equation (2.3) reads 

(at + A)(2)u = /, 
(at + A)®7n(-,0) = 0, 
I ®{dt + A)u{{), ■) = {), 
u(0, 0) = Uq. 
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In Section 4 we will show that second moments and covariances of stochastic and random 
partial differential equations are solutions of the tensorized partial differential equation (2.3) 
with uq and / chosen appropriately. 

3. Stochastic partial differential equations 

In this section, we consider stochastic partial differential equations and their mild solutions 
in the framework of [3] and [5]. 

Let (Q,A, {J-t)t>Oi P) be a filtered probability space that satisfies the "usual conditions". 
Furthermore, let {H, {•,-)h) be a separable real Hilbert space with corresponding norm de- 
noted by II • \\h- The Lebesgue-Bochner space L^{^;H) is the space of all square integrable, 
i?- valued random variables, i.e., the space of all iJ- valued random variables X such that 

\\X\\hin;H) :=E[||X||l,]<+oo. 

For all X G L^(r2; H), the second moment of X 

m(2)x := E[X(2)] = E[X (g) X] 
is well-defined as an element of if^^^ since 

||m(2)x||^(2) <E[||X(2)||^(,)] =E[||X||2,] = \\X\\l,^^.Hy 

Furthermore, we define the covariance Cov(X) of X e Lp'{Vt\H) by 

Cov(X) :=M(2)(X-E[X]), 

i.e., Cov(X) is the centered second moment of X. 

Let us denote by Ljjj {H) the space of all nonnegative, symmetric, nuclear operators on H. 
Then there exists a unique operator Q e {H) such that 

(Cov(X),(/?(g) V)if(2) = {Q(p,tp)H, 

for all (fjtp G H. The operator Q is called the covariance operator of X. 

For Q G Ljjj (H), the i/-valucd stochastic process W := {W{t),t G M_|_) is called a Q-Wiener 
process if it starts in zero P-almost surely, it has P-almost surely continuous trajectories, the 
increments are independent, and for s <t, the increment W{t) — W{s) is Gaussian distributed 
with expectation zero and covariance operator (t — s)Q. Let us denote by q the covariance 
in ij(^) that corresponds to Q, i.e., q is uniquely defined by the condition 

(g, <^ <^ V')ff(2) = {Q'p,ik)H, 

for all (f,i{j E H. Since Q G L^{H), there exists an orthonormal basis (e„,n G N) of 
consisting of eigenvectors of Q. Therefore, we have the representation Qe„ = ^n^n-, where 
7„ > is the eigenvalue corresponding to e^, for n G N. Then the square root of Q is defined 
as 

for ip £ H, and Q~^^'^ denotes the pseudo inverse of Q^^'^. Let us denote by {%,{•, •)'h) 
the Hilbert space defined by H := Q^^'^{H) endowed with the inner product (V',^)-h '■= 
{Q~'^/'^iI},Q''^/'^4>)h, for ilj,(f) eH. Let Lns{H]H) refer to the space of all Hilbert-Schmidt 
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operators from H to H, and by || • Wl^s (H;H) we denote the corresponding norm. It holds that 
q has an expansion with respect to the eigenvalues and eigenvectors of Q given by 



(3.1) 



Furthermore, W admits a Karhunen-Loeve expansion, i.e., for all i G T, it holds that 



W{t) = Y,{W{t),en)H en = Yl ^n(t) 



where {Wn,n G N) is a sequence of independent, real-valued Brownian motions. 
For t G T, let us denote by 

$(s) dW{s) 

the stochastic integral with respect to $ G L,y^r^{H) with 

rT 



E 



J 

Jo 



ds 



< +00. 



Here, l4^j{H) := L'^{n x T; Lrs H)) denotes the space of integrands with respect to the 
measure space (f2 x T,Vt, P'Si X), where Vj is the a-algebra of predictable sets in f2 x T and 
A denotes the Lebesgue measure. 

Then the stochastic integral satisfies the Ito isometry 



(3.2) 



e[|| [\{s)dW{s)\\l 
. Jo 



E 



Ms) 



I ins {H;H) 



ds 



for all t G T. For an introduction to stochastic integrals with respect to Hilbert-space- valued 
stochastic processes, the reader is referred to [2, 3, 5, 6]. 
We define the weak stochastic integral by 

f\^{s), $(s) dW{s))H := r i*(s) dW{s), 
Jo Jo 

for t G T, with ^^{s) eH*, se T, such that for all u G H 

$xi>(s)m := {'^{s),^{s)u)h, 

where \I' is an if- valued, continuous, adapted stochastic process and $ G jiH). The weak 
stochastic integral is well-defined (cf. [5]). Since the stochastic integral is a martingale (cf. 
Theorem 4.12 in [3]), it satisfies for t G T that 



(3.3) 



E 



(^(S),$(S) dWis))H 



^0 



E 



^^{s)dW{s)\j^o 



0. 



Furthermore, the weak stochastic integral satisfies a general Ito isometry, which is shown in 
the following lemma. 

Lemma 3.1. Let vi,V2 G C^{T;H) and $ G E'^j{H). Then the weak stochastic integral 
satisfies 



E 



{vi{s) 



, $(S) dW{s))H [\v2{s'), $(s') dW{s'))H 

Jo 
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{vi{s) (g) V2is),E[<^{s) (g) $(s)]g)//{2) ds. 



Proof. Let t G T be fixed. Using the Karhunen-Loeve expansion of W, we rewrite the weak 
stochastic integral 

f-t t» r-t 

/ {viis),^s)dW{s))H = y2^n'^^ / {vi{s),^is)en)HdWn{s). 
•^0 n=l 

Then the independence as well as the martingale property of the real-valued Wiener pro- 
cesses Wn, n G N, implies that 

E \ [\v,{s), dW{s))H f\v2{s'), dW{s'))H 
Jo JO 

°° r i-t 

J2 T^'t^/'E / {vi{s),^s)en)HdWn{s) / {v2{s'),^s')em)HdWmis') 
n,m=l Jo J 

°° r f-t r-t 

en)HdWn{s ) 

n=l Lio 7o J 

= V7nE / (ui(s),$(s)en)i/(v2(s),$(s)en)ifds , 

n=l J 

where we applied an Ito isometry for real- valued Wiener processes (sec Proposition 1.2 in [4]) 
in the last step. By the definition of the tensor product and of g in (3.1), we get that 

VthIE / {vi{s),^s)en)H{v2{s),^s)en)Hds 

n=l ^-^0 ^ 

oo 

vi{s) <^ V2{s),^-fnms)en) ($(s)e„)\ ds 



Jo 

[ {vi{s) (g) V2{s),E[^{s) (8) $(s)]g)i/(2) ds, 
Jo 



which finishes the proof. 



□ 



Having introduced some properties of Hilbert-space- valued random variables and the sto- 
chastic integral with respect to a Q- Wiener process, we start the discussion of the stochastic 
partial differential equation 

(3.4) dX{t) + AX{t) dt = dW{t) 

with /"o-measurable initial condition X{0) = Xq G LP'{VL;H), for i G T. Here, is a Q- 
Wiener process and A satisfies the assumptions that were made in Section 2, i.e., A is a linear 
operator that is densely defined, self-adjoint, positive definite, and not necessarily bounded 
but with compact inverse. Then (3.4) admits a unique mild solution X, i.e., X is a predictable 
process that satisfies sup^g^ ||-^(0llL2(n;//) < +00 and 

X{t) = S{t)Xo+ [ S{t-s)dW{s), 
Jo 
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for all t e T. Furthermore, this solution is equal to the unique weak solution, i.e., X is a 
predictable process that satisfies sup^g^ ||-'^(i)||L2(n.j^) < +00 and for all (p G 'D{A*) and t G T 

{if, X{t))H = iv, Xo)h - tiA*^, X{s))h ds + {if, W{t))H. 



Recall that, although ^ = ^4* is self-adjoint, we write A* when the operator appears as an 
adjoint operator. The solution X of (3.4) has certain properties. In the following lemma, we 
establish another weak formulation. There we use the space of test functions 

Cl^r,y{T;V{A*)) := {<f> G C\T;V{A*)), ^{T) = 0}. 

Lemma 3.2. Let X he the mild solution of the stochastic partial differential equation (3.4). 
Then X satisfies for all G Cq ^^-^(T; P(^*)) P-almost surely that 

{X, i-dt + ^*)<^)l2(T;H) = (^0, HO))h + riv'it), dWit))H. 

Jo 

Proof. The lemma is a direct consequence of (9.20) in [5], where we use that ip{T) = by 
definition. □ 

Furthermore, we prove regularity of the second moment of the solution. 

Lemma 3.3. The second moment M^'^^X of the mild solution X of (3.4) is an element 

ofXi^l 

Proof. We first observe that 



<E[||X(2)| 



Using the definition of the norm and the independence of the stochastic integral of J'q, we 
obtain that 



H\\X\\x]= [ E A^/^S{t)Xo + A^/^ [ S{t-s)dW{s) 
Jo L Jo 

r \\A^/'^S{t)XofHdt\ + f A^/'^Sit- s)dW{i 

Jo 1 Jo I Jo 



= E 



For the first term we use that loi v e H 
(3.5) 



dt. 



[ \\A^/^S{t)vfHdt< l\\vfH, 
Jo 



which is easily proved by the spectral representation of S{t). Hence, the first term is bounded 
by 5ll-'^o||^2(-f2.ij)- second term we apply the Ito isometry (3.2), the definition of the 

Hilbert-Schmidt norm, and again (3.5) to get 



E 



f A^/^S{t-s)dW{s] 
Jo 



= / \\A^^^S{t- 
Jo 

= y^lnl \\A^'^S{t-s)en\\]jds<\TY{Q). 

•''0 



This leads to 

||M(2)X||;,(.) < i(||Xo||i2(f,.^) +TTr(g)) < +00 
by our assumptions on Xq and Q. 



□ 
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4. COVARIANCE PARTIAL DIFFERENTIAL EQUATION 

In this section we calculate second moments and covariances of two different classes of 
stochastic evolution partial differential equations. First, we look at random partial differential 
equations, where the initial condition and the right hand side of (2.1) are random variables. 
In a second step we deal with mild solutions of the parabolic stochastic partial differential 
equation (3.4). We show that second moments and covariances of the equations are equal to 
the unique solution of the tensorizcd partial differential equation (2.3), where the parameters 
uq and / in (2.3) have to be chosen according to the random or stochastic partial differential 
equation. 

4.1. Random partial differential equation. In the framework of Section 2, let us consider 
in a first step the random partial differential equation 

(4.1) {dt + A)U = F 

on the time interval T with initial condition U{0) = Uq e L'^{9.\H) and F G Lp'iVt^y*). For 
almost every fixed CiJ € Jl, it holds that Uq{uj) G H and F{u) G y* and it was shown in 
Section 2 that the weak variational problem 

(4.2) B{u, v) = {F{u),v)y + {Uo{uj),v{0))h 

has a unique solution u & X that depends on u and that we denote by U{u) := u. Further- 
more, since dt + Ais an isomorphism with bounded inverse, U is an -Y-valued random variable 
that is in L^(J7; Af) by the properties of Uq and F. Therefore, C/ is a solution of (4.1) in the 
sense that U G L^{^l;X) and U{oj) satisfies the weak variational problem (4.2) for almost 
every a; G ri. 

Since U G L'^{Q; X), the second moment M^'^^U of the variational solution U of the random 
partial differential equation (4.1) is well-defined. Furthermore, M^^^U satisfies for vi,V2 G y 
that 

5(2)(m(2)[/, vi ^ V2) = E[BiU, Vi)B{U, V2)] 

= E[{y4F,Vi)y + {Uo,VimH)iy,{F,V2)y + {Uo,V2mH)] 

= y(2,.(M(2)F,?;i 0V2)yi2) + (M(2)c/o,(,;i 0t,2)(O,O))^(2) 

+ Ely, {F, VI )y {Uo, V2iO))H] + E[{Uo, ViiO))H y, {F, V2)y]. 

The two summands in the last line will be equal to zero if we assume that F and Uq are 
independent and that E(F) = or E{Uo) = 0. This implies that M^^^J/ solves the weak 
variational problem (2.3) with uq ■= M^^^C/q and / := M^^^F, if F and Uq are independent 
and if E{F) = or E(;7o) = 0. 

Let us next look at the covariance Cov(;7) = M(2)(?7 - E[U]) of the solution U of (4.1). It 
satisfies for vi,V2 G 3^ that 

B^^\Coy{U),vi V2) = E[B{U - E[U],vi)B{U - E[U],V2)] 

= y(2)*{Cov{F),Vl ®V2)y{2) + (Cov(C/o), {Vl ®V2){Q,Q))Hm 

+ E[y, {F - E[F],vi)y {Uo - E[Uo],V2iO))H] 

+ E[{Uo - E[Uo],VliO))H {F - E[F],V2)y], 

since 

B(E[U],v) = E[B{U, v)] = E[y. {F, v)y + {Uo,v{0))n] = y* { E[F],v)y + (E[C/o], t;(0))j^. 
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for all V & Therefore, Cov(C/) solves the weak variational problem (2.3) with uq := Cov(i7o) 

and / := Cov(F), provided that F and Uq arc independent. 

We have thus seen that, under additional assumptions concerning the independence and 
the expectation of the data Uq and F, the second moment and the covariance of the random 
partial differential equation (4.1) are the unique solutions of the tcnsorized partial differential 
equation (2.3) with appropriately chosen data uq and /. We will see in the next section 
that such assumptions are naturally met by the data of the stochastic partial differential 
equation (3.4). 

4.2. Stochastic partial differential equation. In this subsection we consider the second 
moment M^'^^X of the mild solution X of the stochastic partial differential equation (3.4) with 
initial condition Xq € L^(r2; H) and show that it is equal to the unique solution of the weak 
variational problem (2.3), where uq = M^'^^Xq and / = 5^q. Here, 5 is a Dirac distribution 6 
to be introduced next. 

To describe the temporal correlation of the Q- Wiener process W, we define the distri- 
bution 6 in the sense of L. Schwartz as functional acting on test functions (f) G Cq^{T^;R) 
by 

{S, 0)l2(T;M)(2) = S) ds. 

Therefore, (5 is a measure which is supported on the diagonal of T^. By Lemma 3 in [10], 
S G H-^-^{T'^;R) = F-*(T;R)(2), for s > 1/4. In the following lemma we prove that an 
additional spatial regularity assumption on the covariance operator Q combined with the 
low temporal regularity of the Wiener process implies that the tensor product 5(8)^' is in 
H-^{T; y)(2) and therefore in y^'^>. 

Lemma 4.1. Let Tr{AQ) < +oo. Then S^q G y^'^>. 

Proof. We first remark that Tr(^Q) < +00 implies by (3.1) that 



00 



y(2) 



< ^^InWen^enWvC^) = Tt{AQ) < +00, 

n=l ' n=l 

and hence that q G V^'^\ It remains to show that 5 G i?~^(T;M)(^) to finish the proof. This 
is true since 5 G ii"-^(T;M)(2), for all s > 1/4 by Lemma 3 in [10]. □ 

Having shown some regularity of the expression 5®q, we are now able to state and prove 
the main result of the paper. 

Theorem 4.2. Let X he the mild solution of the stochastic partial differential equation (3.4) 
with -measurable initial condition Xq G L'^{il;H). Moreover, assume that Tr(y4(5) < +00. 
Then the second moment Wl^X solves the weak variational problem (2.3) with uq := WI^'^^Xq 
and f := 



Proof. First, we remark that the embedding ^j.y{T;'D{A*)) C y is continuous and dense. 
Therefore, it is sufficient to show (2.3) for vi ® V2 with v\^V2 G ^rj,^{T]T>{A*)). So, let 
vi,V2 G Cq ^rp^{T\'D{A*)). Then using the definition of the bilinear form B^'^\ we obtain that 

H(2)(m2x, VI ® V2) = xC^){M^X, i-dt + A* f\vi ® V2));^i2). 

= E[^{X, {-dt + A*)v^)^, ^{X, {-dt + A*)v2);,.]. 
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Furthermore, the regularity of vi and V2 imphes that 

E[;,{X, {-dt + A*)VI);,. ^{X, {-dt + A*)V2);,,\ 

The appUcation of Lemma 3.2 leads to 

E[{X, {-dt + A*)vi)mT.H){X, {-dt + A*)v2)LHf,H)] 



E[{Xo,vi{0))h{Xo,V2{0))h] + E 



+ E 



[ {vi{t),dW{t))H{Xo,V2{0))H 

Jo 



{Xo,vi{0))h r {v2{t),dW{t))H 

Jo 

T 



+ E 



{vi{t),dW{t))H / {v2{t)AW{t))H 

Jo 



The second and third terms on the right hand side are equal to zero by (3.3) and since Xq 
is J^D-measurable. We apply Lemma 3.1 to the fourth term and the definition of the tensor 
product to the first and the fourth terms to derive 

E[(X, {-dt + ^*)^i)i2(T;j^)(X, {-dt + A*)v2)L^fj,H)\ 

= (M2Xo,(vi(8)i;2)(0,0))^(2) + {5®q,vi® V2) l2(j.h)C^). 

The desired assertion now follows, since 

{5®q, vi (g) V2) L2(T;if)(2) = y(2)* {S^q, vi (g) ^2)^(2) , 

due to Lemma 4.1 and the properties of vi and V2- □ 

Corollary 4.3. Under the assumptions of Theorem 4-2, the covariance Cov(X) of the mild 
solution X of (3.4) satisfies 

B^^\Coy{X),v) = y^2).{d^q,v)y^2) + {Cov{Xo),v{0,0))h(2), 

for all V G y^'^\ and therefore it solves the weak variational problem (2.3) with uq := Cov(Xo) 
and f := S^q. 

Proof For all t G T, it holds that 

X{t) - E[X{t)] = S{t)Xo + [ S{t- s) dW{s) - S{t) E[Xo] 

Jo 

= S{t){Xo -E[Xo])+ [ S{t-s)dW{s), 
Jo 

i.e., if X is a mild solution of (3.4) with initial condition Xo, then X — E[X] is mild solu- 
tion of (3.4) with initial condition Xq — E[Xo]. The assertion follows by an application of 
Theorem 4.2 to the transformed equation. □ 
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